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Abstract 

The purpose of this paper is to formulate and solve a H°° controller synthesis problem for a class of non-commutative linear 
stochastic systems which includes many examples of interest in quantum technology. The paper includes results on the class of 
such systems for which the quantum commutation relations are preserved (such a requirement must be satisfied in a physical 
quantum system). A quantum version of standard (classical) dissipativity results are presented and from this a quantum version 
of the Strict Bounded Real Lemma is derived. This enables a quantum version of the two Riccati solution to the H°° control 
problem to be presented. This result leads to controllers which may be realized using purely quantum, purely classical or a mixture 
of quantum and classical elements. This issue of physical realizability of the controller is examined in detail, and necessary and 
sufficient conditions are given. Our results are constructive in the sense that we provide explicit formulas for the Hamiltonian 
function and coupling operator corresponding to the controller. 

Keywords: quantum feedback control, H°° robust control, dissipativity, strict bounded real lemma, quantum optics, quantum 
controller realization. 
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I. Introduction 

Recent developments in quantum and nano technology have provided a great impetus for research in the area of quantum 
feedback control systems; e.g., see [1], [4], [12], [16], [27], [29], [30]. In particular, it is now being realized that robustness is 
a critical issue in quantum feedback control systems, as it is in classical (i.e., non-quantum) feedback control systems; e.g., see 
| [10], [11], [31]. However, the majority of feedback control results for quantum systems do not address the issue of robustness 
. directly. The aim of this paper is to address the problem of systematic robust control system design for quantum systems via 
t-H ; a H°° approach. 

We present a H°° controller synthesis result for a class of non-commutative linear stochastic systems which includes many 
' examples of interest in quantum technology. The synthesis objective is to find a disturbance attenuating controller which bounds 
f~>) , the influence of certain signals, called the disturbance input signals, on another set of signals, called the performance output 
signals. In this way, the undesirable effects of disturbances on performance is reduced in a systematic and quantifiable way. 
This follows from a quantum version of the small gain theorem [11]; indeed, the controller will be robustly stabilizing against 
certain kinds of uncertainties, which in principle could include parameter uncertainties, modelling errors, etc. To illustrate the 
£h . results, we consider some design examples in quantum optics. 

A feature of our approach is that the control designer can choose to synthesize a controller which may be quantum, classical or 
Z3 , a mixed quantum-classical controller for the plant. The majority of the available results in quantum feedback control consider 
^-j the controller to be a classical (i.e., non-quantum) system, which may be implemented using analog or digital electronics. 
J> , Classical controllers process measurement data obtained by monitoring the quantum system to determine control actions which 
influence the dynamics of the quantum system in a feedback loop. In contrast, quantum controllers are themselves quantum 
systems, and the closed loop is fully quantum; e.g., see [5], [11], [18], [28]-[30]. In [29], [30], a transfer function approach to 
' quantum control based on the chain scattering approach to H°° control has been proposed. However, the plants and controllers 
considered therein are SISO (single input single output) systems having only quantum degrees of freedoms. Moreover, no 
systematic treatment is given of the physical realizability of the resulting controllers. On the other hand, our approach is 
developed for a fairly general class of MIMO (multiple input multiple output) quantum linear stochastic systems with possibly 
mixed quantum and classical degrees of freedom and addresses the physical realizability issue. 

Our approach involves deriving a quantum version of the Strict Bounded Real Lemma (e.g., see [20]). We begin by considering 
a general problem of dissipativity for quantum systems in a manner that generalizes Willems' theory of dissipative systems 
(see [26]), originally developed for nonlinear deterministic classical systems. The paper characterizes this dissipation property 
in algebraic terms. This then leads to a quantum version of the Strict Bounded Real Lemma. This lemma is then applied to the 
closed loop system formed from the interconnection between the quantum plant and the controller. By following an algebraic 
approach to the H°° control problem such as in [20], this enables us to derive a quantum version of the celebrated two Riccati 
solution to the H°° control problem; e.g., see [15], [32]. 

The two Riccati quantum H°° result which is derived leads to formulas for some, but not all, of the controller state space 
matrices. Controller noise sources (needed for physical realizability, as discussed shortly) are not determined by these Riccati 
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equations. If the designer chooses to synthesize a classical controller, then the standard classical H°° controller suffices, and 
no further matrices nor noise sources need be determined. However, if the designer chooses to synthesize a controller that is 
itself a quantum system, or contains a component that is a quantum system, then the controller design must be completed by 
selecting the undetermined matrices and noise sources to ensure that the controller is physically meaningful. For example, in 
a quantum controller, quantum mechanics dictates that the time evolution of a closed system preserve certain commutation 
relations. This requirement constrains the possible controller matrices and noise sources for a physically realizable controller. 
To address this issue, the paper considers the question of physical realizability. Starting with a standard parameterization of 
purely quantum linear systems in terms of a quadratic Hamiltonian and a linear coupling operator (e.g., see [13]), we then 
derive necessary and sufficient conditions for given controller state space matrices to be physically realizable. These conditions 
are constructive in that if a set of controller state space matrices are physically realizable, then we can construct the required 
Hamiltonian function and coupling operator. 

We begin in Section |II]by presenting the class of models under consideration and we present a result describing the condition 
such systems must satisfy in order to correspond to a physical quantum system in that the quantum commutation relations are 
preserved. In Section [IV] we consider the question of dissipation for quantum systems and derive a quantum version of the 
Strict Bounded Real Lemma. In Section [V] we set up the H°° problem to be solved and present our main result which is a 
two Riccati solution to this quantum H°° control problem. This section also considers the question of physical realizability. 
In Section |VI| we consider the application of our quantum H °° control results to the question of stability robustness and we 
establish a version of the small gain theorem for quantum systems subject to parameter uncertainty. In Section [VTll we present 
some examples from quantum optics to illustrate the theory which has been developed. In particular, we consider the control 
of quantum optical plants using quantum, classical, and quantum-classical controllers. We also consider the design of a purely 
quantum controller which leads to robustness against uncertainty in one of the physical parameters of the cavity system. The 
paper is organized so that the appendix contains all of the proofs of the results which are presented. 

Acknowledgments. The authors wish to thank V. R Belavkin, E. Huntington, H. Mabuchi, J. Gough, L. Bouten and 
R. van Handel for helpful discussions. 



II. Linear Quantum Stochastic Models 

In this paper, we are interested in physical systems that contain one or more components that are quantum in nature. It is 
helpful to have in mind an interconnection of components, some of which are "classical", meaning that non-quantum descriptions 
suffice, and some for which "quantum" descriptions are required. Such systems are common in quantum optics laboratories, 
and may occur, for instance, in schemes for implementing quantum computing and information processing algorithms. We use 
non-commutative or quantum probability theory (e.g., see [7] and the references therein) to describe the systems of interest. 
This framework is quite general and encompasses quantum and classical mechanical systems. Quantum noise, which may arise 
from measurements or interactions between subsystems and the environment, is central. 

We consider linear non-commutative stochastic systems of the form 

dx(t) = Ax(t)dt + Bdw(t); x(0) = x a 

dy(t) = Cx(t)dt + Ddw(t) (1) 

where A, B, C and D are, respectively, real l™ Xn ,K' ,>< ''« , ,R'^ )<n and ffi ra v Xn » matrices (n,n w ,n y are positive integers), 
and x(t) — [ xi(t) ... x n (t) ] T is a vector of self-adjoint possibly non-commutative system variables. 

The initial system variables x(Q) = xq consist of operators (on an appropriate Hilbert space) satisfying the commutation 
relation^ 

[x j (0),x k (0)]=2i@ jk , j,k = l,...,n, (2) 

where is a real antisymmetric matrix with components Qjk, and i = \f—\. Here, the commutator is defined by [A, B] = 
AB — BA. To simplify matters without loss of generality, we take the matrix to be of one of the following forms: 

• Canonical if = diag( J, J, . . . , J), or 

• Degenerate canonical if = diag(0„' X n' , J,..-, J), where < n! < n. 
Here, J denotes the real skew-symmetric 2x2 matrix 



and the "diag" notation indicates a block diagonal matrix assembled from the given entries. To illustrate, the case of a system 
with one classical variable and two conjugate quantum variables is characterized by = diag(0, J), which is degenerate 
canonical. It is assumed that xq is Gaussian, with density operator p. 

'in the case of a single degree of freedom quantum particle, x = (xi, xi) T where x\ = q is the position operator, and X2 = p is the momentum operator. 
The annihilation operator is a = (q + ip)/2. The commutation relations are [a, a*] = 1, or [q,p] = 2i. 
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The vector quantity w describes the input signals and is assumed to admit the decomposition 

dw(t) = f3 w (t)dt + dw(t) (3) 

where w(t) is the noise part of w(t) and j3 w (t) is a self adjoint, adapted process (see, e.g., [7], [19], [21] for a discussion of 
adapted processes). The noise w(t) is a vector of self-adjoint quantum noises with Ito table 

dw(t)dw T {t) = Fj,dt, (4) 

where is a non-negative Hermitian matrix; e.g., see [6], [19]. This determines the following commutation relations for the 
noise components: 

[dw(t), dw T (t)} = dw(t)dw T (t) - (dw(t)dw T (t)) T = 2Tv,dt, (5) 

where we use the notation Su, = \(Fw = \{Fa — F^) so that F^, = Su, + . For instance, F^ = diag(l, I + iJ) 

describes a noise vector with one classical component and a pair of conjugate quantum noises (here / is the 2x2 identity 
matrix). The noise processes can be represented as operators on an appropriate Fock space (a particular, yet important, type 
of Hilbert space); e.g., see [6], [19]. 

The process (3 W (t) serves to represent variables of other systems which may be passed to the system (HJ via an interaction. 
Therefore, we require that f3 w (0) is an operator on a Hilbert space distinct from that of xq and the noise processes. We also 
assume (3 w (t) commutes with x(t) for all t > (two vectors x, y of operators are said to commute if xy T — (yx T ) T = 0); this 
will simplify matters for the present work. Moreover, since we had earlier specified that (3 W (t) should be an adapted process, 
we make note that (3 w (t) also commutes with dw(t) for all t > 0. 

To simplify the exposition, we now set up some conventions to put the system ([TJ into a standard form. First, note that 
there will be no change to the dynamics of x(t) and y(t) if we enlarge w(t), by adding additional dummy noise components, 
and at the same time enlarging B by inserting suitable columns of zeros. Secondly, we may add dummy components to y by 
enlarging C and D by inserting additional dummy rows to each of these matrices. Our original output can be recovered by 
discarding or "disconnecting" the dummy components/entries. Therefore, we make the following assumptions on the system 
O: (i) n y is even, and (ii) n w > n y . We also make an assumption that Fa, is of the canonical form Fw = J + idiag(J, . . . , J). 
Hence n w has to be even. Note that if F^ is not canonical but of the form Fa = I + idiag(0„' X n', diag( J, . . . , J)) with 
n' > 1, we may enlarge w(t) (and hence also w(t)) and B as before such that the enlarged noise vector, say w', can be taken 
to have an Ito matrix Fu,< which is canonical. 

Equation ((TJ is a linear quantum stochastic differential equation. General quantum stochastic differential equations of this 
type are described in [21], [19], [6]. In (Q~|i the integral with respect to dw(t) is taken to be a quantum stochastic integral. The 
solution x(t) depends only on the past noise w(s), for < s < t; i.e., it is adapted, and a property of the Ito increments is 
that dw(t) commutes with x(t). 

Equation (fl]i describes a non-commutative linear stochastic system, which need not necessarily correspond to a physical 
system. This issue does not normally arise in physical modeling, but as we shall see it is of considerable importance when 
we come to synthesizing physically realizable controllers below in Section [TIT] and Subsection IV-DI The following theorem 
provides an algebraic characterization of precisely when the linear system ([T]) preserves the commutation relations as time 
evolves, a property enjoyed by open physical systems undergoing an overall unitary evolution, [14]. The proof is given in the 
appendix. 

Theorem 2.1: Under the assumptions discussed above for the system (Q~|i, we have [xi (0) , Xj (0)] = 2iOy implies [xi(t), Xj (t)] = 
2i<dij for all t > if and only if 

iAQ + iOA T + BT^B T = (6) 

III. Physical realizability of linear QSDEs 

Unlike classical systems, which we may regard here as always being physically realizable (for the purpose of controller 
synthesis), at least approximately via classical analog or digital electronics, a quantum system represented by the linear QSDE 
(Q]i need not necessarily represent the dynamics of a meaningful physical system. An example of a meaningful physical 
system here could be a system made up of interconnection of various quantum optical devices such as optical cavities, beam 
splitters, optical amplifiers. In particular, we have already seen from the previous section that in physical devices, the canonical 
commutation relations need to be preserved for all positive times leading to the requirement that the constraint ^ be satisfied 
by the matrices A and B of (Q~|). However, as we shall shortly see, there is another constraint related to the output signal y(t) 
which is required for (Q]i to be physically realizable. 

A. Open quantum harmonic oscillator 

In order to formally present a definition of an open quantum harmonic oscillator we will require the following notation. For a 
square matrix T, diag m (T) denotes the block diagonal matrix diag(T, . . . , T) where T appears m times as a diagonal block. The 
symbol P m denotes a 2m x 2m permutation matrix defined so that if we consider a column vector a = [ a\ ■ ■ ■ a^m ] T , 
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then P rn a = [ a\ 03 



0>2m-l 0-2 0-4 



An m x m permutation matrix is a full-rank real matrix whose 



columns (or, equivalently, rows) consist of standard basis vectors for R m ; i.e., vectors in R" 1 whose elements are all except 
for one element which has the value 1. A permutation matrix P has the unitary property PP T = P T P = I. Note that 

Pm\ 01 ° 2 •■■ a2m V = I fll a rn+l 0-2 O-m+2 ■■■ &m &2r, 

Let us also further introduce the notation N„ 



dm+2 

-- Y ^ N v 



M 



1 i 
1 -i 



and r = P/v ro diag w (M). Moreover, let * denote the adjoint of a Hilbert space operator (by this we mean that the operator 
is a map from one Hilbert space to another), and let X# denote the operation of taking the adjoint of each element of X, 
where X is a matrix/array of Hilbert space operators. Also, let X^ — (X#) T . 

Then we have the following definition of an open quantum harmonic oscillator by generalizing slightly the linear model 
given in [13, Section 4]: 

Definition 3.1: The system (Q~|i (with (3 = 0) is said to be an open quantum harmonic oscillator if is canonical and there 
exist a quadratic Hamiltonian H = x(Q) T Rx(0), with a real and symmetric Hamiltonian matrix R of dimension n x n, and a 
coupling operator L = Aa;(0), with complex-valued coupling matrix A of dimension n w x n, such that: 

x k (t) = U(t)*x k (0)U(t), k=l,...,n, yi (t) = U(t)* Wl (t)U(t), l = l,...,n y , 

where {[/(£); i > 0} is an adapted process of unitary operators satisfying the following QSDE [13, Section 2.5] : 



dU(t) 



(-iHdt - -tfLdt + [ -L f L T ]Tdw(t))U(t), U(0) = I. 



In this case the matrices A, B, C, D are given by: 



.4 
B 

C 



29(i? + 3(A t A)); 
2i6[-A+ A T ]T; 



P 



D = P 



0n v xN u 

0n v xn u 



A + A* 
-iA + iA* 

Pn w = [ In y x: 







n y x(n w ~7i y ) \l 



(7) 
(8) 

(9) 
(10) 



where £ 



NyXNy 0N y X(N; 



-N v 



B. Augmentation of a linear QSDE 

If O is degenerate canonical then we may perform an augmentation in which 9 is embedded into a larger skew symmetric 
matrix which is canonical up to permutation (this means becomes canonical after permutation of appropriate rows and 
columns). To do this, let 6 = i=n'+i ... n = diag „-n' (J) if n' < n. Here diag m (J) denotes a m X m block diagonal 

matrix with m matrices J on the diagonal. Define: 







On' xn' 
0(n— n')xi 



o, 



o, 



' x (n—n ! ) 



' x (n—n') 



o 



In' xn' 
(n — n') X7 
On' xn' 



where the middle block of rows is dropped whenever n = n' . Then by definition is canonical up to permutation and contains 
as a sub-matrix by removing appropriate rows and columns of 0. Let n = n + n', the dimension of the rows and columns of 
0. Define the vector x{t) = [x\{t) X2(t) . . . x n (t) z\{t) Z2(t) . . . z n '(t)] T of variables. We now define the following linear 
QSDE 



dx(t) = 

m = 



A 
A' 

C 







nxn c 

A" 



x(t)dt 



B 
B' 



C } x{t)dt + Ddw(t) 



dw{t), 



(ID 



where A', A", B' and C are, respectively, some real n' x n, n' x n', n' x n w and n y x n! matrices, and the initial variables 
i(0) satisfy the commutation relations ioi(0) T — (x(Q)x(0) T ) T = 2i0. We shall refer to the system dTTb as an augmentation 

of GJ. 

Remark 3.2: In the proof of Theorem l3.4l it is shown that the augmentation can be chosen to preserve commutation relations 
whenever the original system does. 
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C. Formal definition of physical realizability 

With open quantum harmonic oscillators and augmentations having been defined, we are now ready to introduce a formal 
definition of physical realizability of the QSDE (HJ. A discussion regarding the definition follows after Theorem 13.41 in which 
necessary and sufficient conditions for physical realizability are given. 

Definition 3.3: The system (Q]i is said to be physically realizable if one of the following holds: 

1) is canonical and ((TJ represents the dynamics of an open quantum harmonic oscillator. 

2) is degenerate canonical and there exists an augmentation (fTTT i which, after a suitable relabelling of the components 
x\{t), . . . ,Xn(i) of x(t), represents the dynamics of an open quantum harmonic oscillator. 

The following theorem, whose proof is given in the appendix, provides necessary and sufficient conditions for physical 
realizability. 

Theorem 3.4: The system (Q]i is physically realizable if and only if: 

iAQ + iQA T + BT W B T 



D 



0, 



= ec 1 p, 



T uT 

N v 



®N y xN y 

-In v xn v 



iNyXNy 

®N v xN v 



P Ny =@C T di agN (J), 



(12) 
(13) 



and D satisfies ( TTOb . Moreover for canonical 0, the Hamiltonian and coupling matrices have explicit expressions as follows. 
The Hamiltonian matrix R is uniquely given by R = i(—QA + A T 0), and the coupling matrix A is given uniquely by 

1 (T- 1 ) T B T Q. (14) 



A 







In the case that is degenerate canonical, a physically realizable augmentation of the system can be constructed to determine 
the associated Hamiltonian and coupling operators using the above explicit formulas. 

Remark 3.5: Note that the Hamiltonian and coupling operators are determined by i\2i , while conditions (TTOb and ( fT3l l relate 
to the required form of the output equation. 

Remark 3.6: It is possible to consider the problem of realization more broadly than discussed above by including additional 
components, such as beam splitters and phase shifts that commonly occur in quantum optics. While Theorem 13 .41 characterizes 
the existence of physically realizable controllers, detailed development of an efficient realization methodology is beyond the 
scope of the present paper. 



IV. Dissipation Properties 

In this section, we describe various dissipation properties frequently used in control engineering, suitably adapted to the 
quantum context. These properties concern the influence of disturbance inputs on energy transfers and stability. In particular, 
we give a quantum version of the Strict Bounded Real Lemma (Corollary 14. 5t which will be employed in section [V] for 
quantum H°° controller synthesis. In this section, we consider the following quantum system of the form ([T): 



dx(t) = Ax(t)dt + [B G ][ dw(t) T 
dz(t) = Cx(t)dt + [D H ][ dw(t) T 

In this quantum system, the input channel has two components, dw = (3 w dt - 
dv, which represents additional noise sources. 

Definition 4.1: Given an operator valued quadratic form 



dv(t) T j , 

dv(t) T f (15) 
dw which represents disturbance signals, and 



r(x,0 w ) = [x i 0*]R 



x 



R = 



where 

i?n i?i2 

#12 #22 

is a given real symmetric matrix, we say the system dl~5b is dissipative with supply rate r(x,f3 w ) if there exists a positive 
operator valued quadratic form V(x) = x T Xx (where A is a real positive definite symmetric matrix) and a constant A > 
such that 

(V(x(t)))+ f {r(x(s),[3 w (s)))ds<(V(x(0))}+\t Vt > 0, 



(16) 

for all Gaussian states p for the initial variables x(0). Here we use the shorthand notation (•) for expectation over all initial 
variables and noises, for both the plant and the controller. 

We say that the system ( fT31 ) is strictly dissipative if there exists a constant e > such that inequality ( fT6] l holds with the 
matrix R replaced by the matrix R + el. 
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The term (V(x(i))) serves as a generalization to quantum stochastic systems (|T3T > of the notion of an abstract internal energy 
for the system at time t. On the other hand, the term (r(x(t), /3 w (t))) is a quantum generalization of the notion of abstract 
power flow into and out of the system at time t. Both of these are notions which are widely used in the stability analysis of 
linear and non-linear deterministic systems [24], [26]. The dissipation inequality ( TToT l is a generalization of the corresponding 
inequality that was introduced for classical stochastic systems in [23], see [11]. 

The following theorem, whose proof is given in the appendix, relates the property of dissipativeness to certain linear matrix 
inequalities. 

Theorem 4.2: Given a quadratic form r(x, (3 W ) defined as above, then the quantum stochastic system ( fT5l ) is dissipative with 
supply rate r(x,/3 w ) if and only if there exists a real positive definite symmetric matrix X such that the following matrix 
inequality is satisfied: 

' A T X + XA + R u R 12 + XB 
B T X + Rj 2 Rii 

Furthermore, the system is strictly dissipative if and only if there exists a real positive definite symmetric matrix X such that 
the following matrix inequality is satisfied: 

A T X + XA + R n 
B T X + RT 



< 0. 



< 0. 



i?i2 + XB 

<-12 -^22 

Moreover, if either of ( [PP i or ( [T8l holds then the required constant A > can be chosen as A = Ao, where 

B T 
G T 



(17) 



(18) 



An 



tr 



X [ B G ] F 



Here, the matrix F is defined by the following relation: 



Fdt 



dw 
dv 



[ dw T dv T 



(19) 



(20) 



x 



< 0. 



We now present some corollaries to the above theorem corresponding to special cases of the matrix R defined in terms of 
the error output operator (3 z (t) = Cx(t) + Dj3 w {t). 

Definition 4.3: The quantum stochastic system ( TT3T > is said to be Bounded Real with disturbance attenuation g if the system 
(fl~5b is dissipative with supply rate 

C T C C T D 
D T C D T D — g 2 I 

Also, the quantum stochastic system $15[ is said to be Strictly Bounded Real with disturbance attenuation g if the system ( TT3T > 
is strictly dissipative with this supply rate. 

Using the above definition of a bounded real system, we obtain the following corollary from Theorem 14.21 (e.g., see also 
[8] for the corresponding classical result.) 

Corollary 4.4: The quantum stochastic system ( fT5l ) is bounded real with disturbance attenuation g if and only if there exists 
a positive definite symmetric matrix X £ M. nxn such that the following matrix inequality is satisfied: 

A T X + XA + C T C C T D + XB 
B T X + D T C D T D — g 2 I 

Furthermore, the quantum stochastic system is strictly bounded real with disturbance attenuation g if and only if there exists 
a positive definite symmetric matrix X € R nxn such that the following matrix inequality is satisfied: 

A T X + XA + C T C C T D + XB 
B T X + D T C D T D — g 2 I 

Moreover, in both cases the required constant A > can be chosen as A = Ao, where Ao is defined by (fl9l l, 

Now combining this corollary with the standard Strict Bounded Real Lemma (e.g., see [20], [33]) we obtain the following 
Corollary. 

Corollary 4.5: The following statements are equivalent 

(i) The quantum stochastic system (fl~5b is strictly bounded real with disturbance attenuation g. 

(ii) A is a stable matrix and \\C(sI - A)~ l B + D||oo < .9- El 

(iii) g 2 I — D T D > and there exists a positive definite matrix X > such that 

A T X + XA + C T C +{XB + C T D)(g 2 I - D T D)- 1 (B T X + D T C) < 0. 

2 The H°° norm notation used here is standard [32], and applies to the classical transfer function C(sl — A)^ 1 B + D, not the quantum system )15t . In 
this paper we do not define nor use transfer functions for quantum systems. 



< 0. 
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(iv) g 2 I — D T D > and the algebraic Riccati equation 

A T X + XA + C T C + (XB + C T D){g 2 I - D T D)- 1 (B T X + D T C) = 

has a stabilizing solution X > 0. 
Furthermore, if these statements hold then X < X. 

V. H°° Controller Synthesis 

In this section, we consider the problem of H°° controller design for quantum systems. As we shall see, we do not restrict 
ourselves to classical controllers. The closed loop plant-controller system is defined in Subsection IV- Al and then in Subsection 
IV-CI we apply the Strict Bounded Real Lemma to the closed loop system to obtain our main results. In Subsection, IV-DI we 
provide conditions under which a controller is physically realizable. 



A. The Closed Loop Plant-Controller System 

The general linear model (H) described above is the prototype for the interconnection of components which will make up 
the quantum control system. In control system design, we prescribe a system called the plant, and seek to find another system, 
called a controller, in such a way that desired closed loop behavior is achieved. We now introduce our plant and controller 
models, and the resulting closed loop. 

We consider plants described by non-commutative stochastic models of the following form defined in an analogous way to 
the quantum system (fl}: 

dx(t) = Ax(t)dt+[ B Bi B 2 ][dv(t) T dw(t) T du(t) T ] T ; x(0) = x ; 
dzit) = dx(t)dt + D 12 du(t); 

dy(t) = C 2 x(t)dt + [ D 20 D 2 i 0„ yX „ u ][ dv(t) T dw(t) T du(t) T } T . (21) 

Here x(t) is a vector of plant variables. The input w(t) is represents a disturbance signal of the form (01. The signal u(t) is 
a control input of the form 

du(t) = /3 u {t)dt + du(t) (22) 

where u(t) is the noise part of u(t) and j3 u (t) is the adapted, self-adjoint finite variation part of u(t). Also, dv(t) represents 
any additional quantum noise in the plant. The vectors v(t), w(t) and u(t) are quantum noises with Ito matrices F v , and 
Fu which are all non-negative Hermitian. 

Controllers are assumed to be non-commutative stochastic systems of the form 



(23) 



d£(i) = A K t(t)dt+[B K1 B K ][dv K {t) T dy{t) T f; £(0) = £o 
du(t) = C K £(t)dt+[ B K0 0n u xn v ][ dv K (t) T dy{t) T f 
where = [ £i(t) ... £,n K (t) ] T is a vector of self-adjoint controller variables. The noise 

VK{t) = [ VKi{t) ■ ■ ■ v KK v (t) ] T is a vector of non-commutative Wiener processes (in vacuum states) with non-zero Ito 
products as in (01 and with canonical Hermitian Ito matrix F VK . 

At time t = 0, we also assume that x(0) commutes with £(0). The closed loop system is obtained by making the identification 
Pu(t) = Cjf£(t) and interconnecting d2Tb and d23l to give 



d V (t) = 

dz(t) = 
where rj(t) = [ x(t) T 



A 

BrC 2 



B 2 Ck 
A k 



B 

BrDw 



where 



m 

c 



drj(t) 
dz{t) 



v(t) 
v K {t) 



B 2 B K0 
Bri 

dv(t) 
dv K (t) 



r)(t)dt 

D 12 C K ] v(t)dt + [ D 12 B K0 
T . That is, we can write 

= Arj(t)dt + Bdw(t) + Gdv(t) = Ar](t)dt +[ B G ] 
= Cr](t)dt + Hdv(t) = Cr,{t)dt + [ H ] 





' dv(t) 




' B l 




dv K (t) 


+ 


_ B K D 2l 



dw(t); 



(24) 



dw(t) 
dv(t) 



A 



A B 2 C K 
BkC 2 Ak 



Bi 

BrD 2 i 



G = 



dw(t) 
dv(t) 



Bo B 2 Bko 
BkD 20 Bki 



(25) 



= [ Ci D 12 C K ] ; 6 = [ D 12 B K0 ] . 
Note that the closed loop system ( T25l l is a system of the form (Q~|). 
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B. H°° control objective 

The goal of the controller synthesis is to find a controller (l23l such that for a given disturbance attenuation parameter 

a > 0: 

t ,t 

(2(s) T z(s) + ea;(s) T x(s))ds < (g 2 - e 2 ) / (/3 w (s) T /3 w (s))ds + m + /i 2 t, (26) 
o Jo 

is satisfied for some real constants e, fj, x , fi 2 > 0. Thus the controller bounds the effect of the "energy" of the signal (3 w (t) and 
the noise variances on the "energy" of the signal z(t). 

Necessary and sufficient conditions for the existence of a specific type of controller which achieves this goal for a given 
g are given in the next section, as well as explicit formulas for Ak, Bk and Ck- The results parallel the corresponding 
well-known results for classical linear systems (see, e.g., [3], [20]). 



C. Necessary and Sufficient Conditions 

In order to present our results on quantum H°° control, we will require that the plant system (Bil l satisfies the following 
assumptions. 
Assumption 5.1: 

1) Df 2 D 12 =E 1 >0. 

2) D 21 D% 1 =E 2 >0. 
A - jtol B 2 
Ci D 12 



3) The matrix 

4) The matrix 



is full rank for all lo > 0. 
is full rank for all lo > 0. 



A - jtol B x 
C 2 D 2 i 

Our results will be stated in terms of the following pair of algebraic Riccati equations: 



(A - B 2 E^ 1 Di 2 C\) T X + X(A - B 2 E^D[ 2 C X ) + X(B x Bl - g 2 B 2 E^B' 2 )X 

+g- 2 C({I - D^E^D^d = 0; 



(27) 



(A - B x Dl x E 2 x C 2 )Y + Y(A - B^E^C^ + Y(g~ 2 ClC x - C^E 2 1 C 2 )Y 

+B 1 (I — D 21 E 2 1 D 2X )B X = 0. (28) 

The solutions to these Riccati equations will be required to satisfy the following assumption. 
Assumption 5.2: 

(i) A - B 2 E 1 7 1 Df 2 C 1 + (BxBf - g 2 B 2 E 1 ~ 1 B 2 )X is a stability matrix. 

(ii) A - B x D 21 E 2 l C 2 + Y(g^ 2 C x Ci - C 2 E 2 X C 2 ) is a stability matrix. 
(Hi) The matrix XY has a spectral radius strictly less than one. 

Our results will show that if the Riccati equations (f27), (|28l i have solutions satisfying Assumption 15.21 then a controller of 
the form (|23l will solve the H°° control problem under consideration if its system matrices are constructed from the Riccati 
solutions as follows: 

A K = A + B 2 C K -B K C 2 + {B l -B K D 2 i)B i T X; 
B K = (I -YXy\YCl + B 1 D 2 r 1 )E 2 1 - 

C K = -E 1 - 1 (g 2 BlX + Dl 2 C 1 ). (29) 
We are now in a position to present our main result concerning H°° controller synthesis. 

Theorem 5.3: Necessity. Consider the system (f2Tb and suppose that Assumption 15. II is satisfied. If there exists a controller 
of the form (l23l such that the resulting closed loop system d25l l is strictly bounded real with disturbance attenuation g, then 
the Riccati equations (l27T i. (l28l will have stabilizing solutions X > and Y > satisfying Assumption 15.21 

Sufficiency. Suppose the Riccati equations d27| i, ( |28l have stabilizing solutions X > and Y > satisfying Assumption 
15.21 If the controller (|23l is such that the matrices Ak, Bk, Ck are as defined in ( 1291 , then the resulting closed loop system 
( |25l l will be strictly bounded real with disturbance attenuation g. Also the constant A > in Definition 14.11 can be chosen as 
in ([I9V A = Aq, where the matrix P is as defined in Lemma IA. 1 1 for the closed loop system. 

The controller parameters Bkq, Bkx, and the controller noise vk are not given in the construction described in the sufficiency 
part of Theorem 15.31 They are free as far as the H°° objective is concerned. In the next subsection, we show how they may 
be chosen to give a controller that is physically realizable. 
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D. Physical realization of controllers 

We now show that given an arbitrary choice of commutation matrix ®k for the controller, it is always possible to find 
a physically realizable controller in the sense of Definition 13.31 This means that the controller can be chosen to be purely 
quantum, purely classical, or a combination of quantum and classical components. 

Theorem 5.4: Assume F y = D2oF v D^ + D2\F W D\ V 1 is canonical. Let {Ak, Bk, Ck} be an arbitrary triple (such as given 
by d29il), and select the controller commutation matrix ®k to be canonical or degenerate canonical, as desired. Then there 
exists controller parameters Bko, Bki, and the controller noise vk such that the controller d23l is physically realizable. In 
particular, 2iO K = £(t)£(t) T - (£(i)£(V) T ) T for all t > whenever 2iO K = £(0)£(0) T - (£(0K(0) T ) T . 

The proof of this theorem depends on the following lemma for the case in which 9^ is canonical. For the degenerate 
canonical case, this lemma can be applied to an augmentation of the controller. We shall use the notation of Section IIII-AI 
and as in the discussion in Section [Til we ma y take Bk to have an even number of columns and Ck to have an even number 
of rows. 



Lemma 5.5: Let F y be canonical and {Ak , Bk , Ck } be such that Ak G 



B, 



C 



K G 



ll k Xn K 



riK = 2N^, rriK = 2N y and Ik = 2N U for positive integers N% 
there exists an integer N VK > N u and B K i G R"^ x27V 
realizable with 



N y and N u , and 9^ = diag^ (J) is canonical. Then 
N y , such that the system ( |23l is physically 



with N WK = N VK 



B 



P T 



Oat„ x N u 



On u xn u 



Pi 



mk x2N Vf , 



[ In 







Uy X (n w —n y ) J: 



R 
Bki 
A 



B 



K1A 



B 



IfiT pT 
2 K N u 



Kl,2 

I 
il 



^61 



ly b2 



Bki,i 
A h2 

-8^1,2 



where Z 



-iQ K C K diag Nu (iJ); 

— i [ iNyXNy ^NyXNy 

2iQ K [ -Al Al ] P Nvk - Nn diag^ K _ Nn (M) 
hOAK and N VK > N u + 1. Here Ati is any complex (N VK — N u ) x tik matrix such that 



A L A &i 



+ i[ \{Z-Z T ) 



C T P T 





-I 



P N ^C K -%{A\ 2 A m ) 

is non-negative definite. 



(30) 
(31) 

(32) 

(33) 
(34) 
(35) 



(36) 



where 3 is any real symmetric tik x tik matrix such that the right hand side of 
The proof of Lemma 1331 is given in the appendix. 

Remark 5.6: Note that the condition N VK > N u is significant since it implies that there is no direct feedthrough of the signal 
y(t) to u(t) as required for ( f23l . For compatibility between the equations ( l23l and d2Tb . it is necessary that the corresponding 
Ito matrices satisfy the following condition: 



F u — BkqF Vk B K q- 



(37) 



However, since F VK and F u are, by convention, in canonical form, $3% is always satisfied. To see this, we simply note that 
the 2N U elements of BkoVk are a subset of pairs of conjugate real and imaginary quadratures in vk- Hence it follows that 
if F VK is canonical then F u must also be canonical and (l37T i is automatically satisfied. 



VI. Robust Stability 

The H°° control approach of Section [V] leads to a closed loop quantum system of the form d25l l which is strictly bounded 
real with disturbance attenuation g. We now show that this property can be used to guarantee stability robustness against real 
parameter uncertainties. Indeed, we will suppose that the true closed loop quantum system corresponding to the system d25l ) 
is described by the equations 

dq{t) = Aq(t)dt + Gdv{t) (38) 



where A = A + BAC and A is a constant but unknown uncertainty matrix satisfying 

A T A < 4/. 



(39) 



10 



Definition 6.1: The closed loop quantum system ( T38T > is said to be mean square stable if there exists a real positive definite 
matrix X > and a constant A > such that 

(r](t) T X V (t)) + f (r,(s) T r,(s))ds < ( V (0) T X V (0)) + Xt V<> 
Jo 

for all Gaussian states p. 

The following lemma and theorem relates the robust stability of the above system to its H 00 properties. The proofs of this 
lemma and this theorem can be found in the appendix. 

Lemma 6.2: The quantum system ( f38l > is mean square stable if and only if the matrix A is a stable matrix. 

Theorem 6.3: If the closed loop quantum system d25l l is strictly bounded real with disturbance attenuation g, then the true 
closed loop system ( |38l l is mean square stable for all A satisfying d39l >. 

VII. Synthesis in Quantum Optics 

Quantum optics is an important area in quantum physics and quantum technology and provides a promising means of 
implementing quantum information and computing devices; e.g., see [17]. In this section we give some examples of controller 
design for simple quantum optics plants based on optical cavities and optical amplifiers coupled to optical fields; e.g., see [2], 
[14]. We give explicit realizations of controllers which are fully quantum, fully classical, and mixed quantum-classical using 
standard quantum optical components and electronics. 

A. Quantum Controller Synthesis 

We consider an optical cavity resonantly coupled to three optical channels v, w, u as in Figure [T] The control objective is 
to attenuate the effect of the disturbance signal w on the output z — physically this means to dim the light emerging from z 
resulting from light shone in at w. 




Fig. 1. An optical cavity (plant). 



The dynamics of this cavity system is described by the evolution of its annihilation operator a (representing a traveling 
wave). In the quadrature notation of (TflT i. x\{t) = q(t) = a(t) + a*(t), x 2 {t) = p(t) = (a(t) — a*(t)/i, v(t) = (vi (i), V2{t)) T , 
w(t) = (wi(t),W2(t)) T , u(t) = (ui(t) , U2(t)) T . The quantum noises v, w have Hermitian Ito matrices F v = F$ = I + iJ. 
This leads to a system of the form (f2TT > with the following system matrices: 

A = -|/; B = B x = -v^J; B 2 = -^I; 

(7 = Kl + K 2 + K 3 ) 

Ci = V^I; D 12 = I; 

C2 = sfal; D 21 =I. (40) 

In this model, the boson commutation relation [a, a*] = 1 holds. This means that the commutation matrix for this plant is 
6p = J. 

In our example, we will choose the total cavity decay rate k = 3 and the coupling coefficients ki = 2.6, ^2 = ^3= 0.2. 
With a disturbance attenuation constant of g = 0.1, it was found that the Riccati equations d27b and (f28b have stabilizing 
solutions satisfying Assumption 15.21 These Riccati solutions were as follows: X = Y = 02x2- Then, it follows from Theorem 
14.21 that if a controller of the form d23l l is applied to this system with matrices Ak, Bk, Ck defined as in (|29| | then the 
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resulting closed loop system will be strictly bounded real with disturbance attenuation g. In our case, these matrices are given 
by 

A K = -1.17, B K = -0.4477, C K = -0.4477. 



In this case, the controller d23l ) can be implemented with another optical cavity with annihilation operator clk (with 
quadratures £i = qx = clk + a* K , £2 = Pk = {a-K — o-k)/^ £ = {<1k,Pk) T ), corresponding to Ok = J, connected at 
the output with a 180° phase shifter (see Remark [376b . The controller cavity has coupling coefficients kki = 0.2, kk2 = 1.8, 
K K3 = 0.2, and Kk = 2.2 and is a physically realizable system with dynamics: 



= A K £(t)dt+[ B K i B K ][dv 
du{t) = -C K {(t)dt + [ 7 2x2 2x4 



T 
K 

dv K 



dy T V 
dy T 



where Bki = [ —0.4477 —1.3427 ], vx(t) = (vKii{t) 7 VKi2(t),VK2i(t),VK22{t)y(t)) T are the quadratures of two inde- 
pendent canonical quantum noise sources, and u(t) is the output of the cavity. The overall output of the controller is u(t), 
given by u(t) = K s u{t), where K s = —12x2- Here K s models the 180° phase shift at the output of the cavity. Thus, the 
overall controller (an optical cavity cascaded with a 180° phase shifter) is of the form d23l l with Bko = [— I ] and Bki 
as given before. This controller is illustrated in Figure [2] 




K K 2 — 1.8 



Fig. 2. An optical cavity quantum realization of the controller (0jr = J) for the plant shown in Figure [TJ 



B. Robust Stability in Quantum Optics 

We now modify the above example to allow for uncertainty in one of the optical cavity parameters using the results of 
Section [VT] Indeed, we consider the same set up as in Figure Q] and assume that there is uncertainty in the value of the coupling 
coefficient K\ corresponding to the optical channel v. In this case, the equations (f2Tb describing the optical cavity now have 
matrices 

A = -^-1; B = V«i + SI; B l = -7^7; B 2 = -y^J; 
d = v/^7; 7J 12 =7; 

C2 = y/Ktf; D 21 =I. (41) 

This is our true system which depends on the unknown parameter 5. 

In order to apply our H 00 theory together with the results of Section [Vl] to this system, we must overbound the uncertainty 
in the matrix A. Indeed, let S be any non-singular matrix. If \S\ < \i, then we can write — 17 = B\AC\ where B± = ^S, 
C\ = S~ x and A = — -7 satisfies A T A < 7. Hence, if we consider a family of systems of the form (f2TT > with the system 
matrices 

A = -^J + BiACi; Bo = + SI; B 1 = -^I; B 2 = -^I; 
d = V^7; D 12 = I; 

C 2 = V^I; D 21 =I (42) 
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where A T A < 7, this will include the true system. Now, in order to apply the result of Section[VT]to this problem, we consider 
the 77°° problem defined by a system of the form (|2TT > where 



.4 

B 2 
C10 
C 2 



jl; B = V«i + SI; 



Bio 



■yfel; B x = [ Bio Bi ] 



C10 



Bis 



= yfcl; D 2W = I; D 21 = [ D 2 



I; Di 







B120 




(43) 



Here g is the disturbance attenuation parameter in the 77°° control problem to be considered. Note that the matrix Bq depends 
on the unknown parameter 5. However, this matrix is not involved in the calculation of the B°° controller. 

As in the original example, we will choose the nominal cavity decay rate 7 = 3 and the nominal coupling coefficients of 
«i = 2.6, ^2 = ^3 = 0.2. Also, we let fi = 0.1. That is, we are considering a 10% variation in the coupling coefficient. 
With a disturbance attenuation constant of g = 0.1 and S = 1.51, it was found that the Riccati equations (|27| | and (l28l l have 
stabilizing solutions satisfying Assumption 15.21 These Riccati solutions were as follows: X = 0.17337, Y = 0.00227. Also, 
the corresponding controller matrices were given by 



A K = -1.09977, B K = -0.44647, C K = -0.44647. 



(44) 



Now as in the original example, the controller defined by the matrices d44l i can be implemented by another optical cavity. 
In this case, kkx = 0.1993, Kk2 = 1-8008, Kk3 = 0.1993, and 7^ = 2.1993. As in the original example, the controller is 
illustrated in Figure [2] 

It follows from Theorem |4.2| that the resulting closed loop system satisfies the strict bounded real condition with disturbance 
attenuation g. Indeed, this closed loop system will be described by the equations d25l l where 



A = 



B = 



A B 2 C K 
BrC 2 Ak 

Bi 

BrD 2 \ 



c = [a d 12 c k ] = 



Bio 

BrD 2 io 

C10 
gCi 



Bi 


D120CK 




G = 



Bo 

BrD 2 o 



B 2 Bko 
Bki 



D=[0 Di 2 B K0 ] . 



Now, since this system is strictly bounded real with disturbance attenuation g, it follows from Corollary 
^) _1 -B||oo < <?■ From this, we can conclude that 



that \\C(sI 



and 



C10 Di 20 C K ] (si -Ay 1 
[Ci 0}{sI-A)- 1 



Bio 

BkD 2 w 



< 9 



Bi 




< 1. 



(45) 



(46) 



Using Corollary 14.51 d45b implies that the nominal closed loop system strictly bounded real with disturbance attenuation g. 
Also, d46b implies that the closed loop system 



d V (t) = 



r](t)dt 



Bo 


B 2 Bko 




' dv(t) 




' Bi " 


BrD 2 o 


Bri 




dv K (t) 


+ 






dw(t); 



A B 2 C K 
BrC 2 Ak 

dz{t) = [ Ci ] T)(t)dt 

is strictly bounded real with unity disturbance attenuation. From this, it follows from Theorem 16. 3 1 that the closed loop uncertain 
system 

B2Ba'0 

Bki 



d V (t) 



A + B1AC1 B 2 C K 
BkC 2 Ak 



rj(t)dt 



Bo 

BkDio 



dv(t) 
dv K (t) 



is mean square stable for all matrices A such that A T A < 7. Hence, we can conclude that the true closed loop system is 
mean square stable. 

Note that for this example, it is also possible to verify that the true closed loop system must not only be mean square stable 
but must also be strictly bounded real with disturbance attenuation g. 
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C. Classical Controller Synthesis 

In subsection I VII- Al we obtained a quantum controller corresponding to the choice Ojf = J. We now show that if we instead 
choose Ok = 0, the controller that is realized is classical, with appropriate transitions to and from the quantum plant. 

Now, suppose we choose Vk to be the quadratures of two independent noise channels (i.e., F VK = £4x4 + idiag( J, J)). 
Setting 9 a- = O2X2, Eq. ( fT2b and the compatibility requirement $3% in this context results in the following pair of equations: 

B K JB T K + BA-idiag( J, J)B T K1 = (47) 
B K0 (h x4 + idiag(J, J))B T m =I + iJ. (48) 

In order to find Bkq and Bki solving d4Tb and d48l . we assume the following forms for Bkq and Bki- 

Bko = [ Bko 2X 2 ] ; B K i = [ 2X 2 B K \ ] ■ 
Since Bk = —0.447/, substitution of these forms into d47T i and d48l gives: 

B KQ (I + iJ)B Ko =I + iJ; 0.447 2 J + B K1 JB K1 



0. 



It can be readily checked, by direct substitution, that these equations are solved by Bkq = hx2 and Bki = —0.447/, where 
/ = ^ ^ This completely specifies the classical realization of the controller, illustrated in Figure |3] The quantum 

signal y is converted to a classical signal y c = (y c i,yc2) T — (yi — VK21, VK22 + V2) T by imperfect continuous measurement 
of the real and imaginary quadratures of the optical beam, implemented in Figure [3] by a beam splitter and two homodyne 
detectors [2]. The classical signal y c is processed by a classical linear system (Ak, Bk, Ck, 0) to produce a classical control 
signal u c , which then modulates (displaces) a field vki to produce the optical control signal du = u c dt + dvKi- This classical 
controller achieves exactly the same H 00 performance as the quantum controller of subsection IV11-AI 



Vkl 



classical system 
= A K (,dt + B K dy c _ 
du c — CK^dt 



-V2 



V2 



classical 
gains 



HD(Re) 



HD(Im) 



homodyne 
detection 



50 - 50 beam 
splitter 



Fig. 3. A classical realization of the controller (&k = 0) for the plant shown in Figure [TJ The controller includes quantum measurement and classical 
modulation of optical fields. 



This classical controller has access to the full quantum signal y, and the quantum measurement occurs in the controller. The 
algebra based on the commutation relations enforces the quantum measurement, and also the modulation. If we were to include 
measurement as part of the plant specification, then in general a different classical controller will result, with different H°° 
performance. To see this, suppose that y is replaced by its real quadrature in the plant specification; this situation is described 
by the matrices 



.4 

C 2 



7 



Bi 



■\fK2~I; B 2 = -y^I; 



B = -y/KlI] 

n^r, d 12 = i- 

fci [ 1 ] ; D 21 : 

and is illustrated in Figure |4] Thus the output of the plant is a classical single-variable signal. 

With a disturbance attenuation constant of g = 0.134, it was found that the Riccati equations ( f27T > and d28l ) have the following 
stabilizing solutions satisfying Assumption! 



[1 0] 



(49) 



" 


" 




' 











; y = 





0.121 



X 

It now follows from Theorem 14. 21 that if a controller of the form (|23l l is applied to this system with the following matrices Ak, 
Bk, Ck defined as in d291 l. then the resulting closed loop system will be strictly bounded real with disturbance attenuation 
g = 0.667: 



-1.1 



-1.3 



Br 



-0.447 




,C K 



-0.447 



-0.447 



(50) 
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HD(Re) 



y 




Fig. 4. An optical cavity (plant) with classical output. The (real) quadrature measurement is achieved by homodyne photodetection (HD(Re)). 



In this case, the controller d23l i. d50l l is a classical system which can be implemented using standard electronic devices. This 
second classical controller is illustrated in Figure|5] and is different to the previous one. Here we have chosen Bro = I, Bjci = 
0, and the quantum noise is canonical. The control signal is du = u c dt + dvx, a coherent optical field. 



Mod 



classical system 
d{ = A K £dt + B K dy 
du c — CK^dt 



Fig. 5. Classical controller {Sk = 0) for the plant of Figure f4] 



D. Classical-Quantum Controller Synthesis 

As a final example, we illustrate the synthesis of a controller with both classical and quantum components. The plant has 
two degrees of freedom, and is formed as a cascade of an optical amplifier [14] and the cavity discussed above. This plant is 
illustrated in Figure [6] 




Fig. 6. An optical amplifier-cavity system (plant). 



The optical amplifier has an auxiliary input h, which is an inverted heat bath with Ito matrix Fh = (2N + 1)1 + iJ, where 
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TV > is a positive thermal parameter. The complete system shown in Figure [6] is of the form (fZTJ with matrices 



A = 

C x = 
C 2 = 



.XI 
2 



Jn^at I 
a- P j 



Bo 





[ y/Kil J ; D 12 = I; 

[ y/Kil ] ; D 2a = 0; D 21 = I 















Bo 



(51) 



Here a and (3 are parameters of the optical amplifier. The signals have Ito matrices F u = F^, = I + iJ and F v = diag(/ 
i J, (27V + 1)1 + ij), and the parameters are chosen to be Ki = 2.6, ^2 = ^3 = 0.2, a = 1 and j3 = 0.5. 

With a H°° gain 5 = 0.1, the Riccati equations ( f27T > and d28l ) have stabilizing solutions satisfying Assumption 15.21 X 
y = 02x2- Using d29| i, the controller matrices Ak, Bk, Ck are 



.4 



K 



-1.3894/ -0.4472/ 
-0.2/ -0.25/ 



B 



K 



-0.4472/ 

02x2 



C K = [ -0.4472/ 2x2 ] • 



We choose Qk = diag(J, O2X2) in order to implement a degenerate canonical controller, with both classical and quantum 
degrees of freedom. We write £ = (£ g ,£ c ) T > where £ 9 = (^1,^2 ) T sas classical and £ c = (£,3,£,4) T are quantum variables. A 
realization is shown in Figure [7] which consists of a four-mirror optical cavity, a classical system, and homodyne detection 
and modulation for interfacing the classical and quantum components. The quantum noises in Figure Q are all canonical. 
The cavity has coupling coefficients kki = KK3 = ^ka = 0.2 and kk 2 = 1 .33. The interconnection fields are given by 



dri q = £, q dt + dvK2, and d( q 
have 



B 



Kl 



( c dt + dv Ki , where r) c = {r/d,^) 1 = {% 



-0.4472/ -1.4761/ 
2 x2 -0.1355/ 



02x2 

0.1355/ 



D 



KO 



[ -1 2 



91 - 
-0.4472/ 

02x2 
02x2 ! 



VK31,Vq2 + VK32Y 
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For this realization we 
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Fig. 7. Quantum-classical controller (Ok = diag(J, 02x2)) for the plant of Figure [6] 



VIII. Conclusion 

In this paper we have formulated and solved an H°° synthesis problem for a class of non-commutative stochastic models. 
Models important to quantum technology, such as those arising in quantum optics, are included in this class. We have provided 
results for the physical realization of the controllers. Our results are illustrated with examples from quantum optics, which 
demonstrate the synthesis of quantum, classical and quantum-classical controllers. Future work will include further development 
of the approach initiated here, and application of the synthesis methods to particular problems in quantum technology. 
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Appendix A 
Proofs 

Proof of Theorem \2. 1\ To preserve the commutation relations for all i,j = l,...,n and all t > 0, we must have d[xi,Xj] = 
for all i, j = 1, . . . , n. We now develop a general expression for d[xi, Xj}. Indeed, let e*. = [ ... 1 ... ] T , 
where the 1 is in the fc-th row. It is easy to see that for any i, j E {1, . . . , n}, [ X — 6^ XX Gj XX e,. Therefore, 
d[xi,Xj) = efd(xx T )ej — eJd(xx T )ei. Now, we expand d(xx T ) using the quantum Ito rule (e.g., see [19]) as follows: 

d(xx T ) = (dx)x T + xd{x T ) + dxd(x T ) 

= Axx T dt + Bdwx T + xx T A T dt + xd(w T )B T + Axx T A T dt 2 

+Axd(w T )dtB T + Bdwdtx T A T + Bdw(dw) T B T 
= Axx T dt + Bdwx T + xx T A T dt + xd(w T )B T + B(dw)(dw) T B T . 

Substituting dw = w dt + dw into the above and noting that P w P^dt 2 and (3 w dw T dt vanish to order dt gives 

d(xx T ) = Axx T dt + B(3 lu x T dt + Bdwx T + xx T A T dt + xj3^B T dt + xdw T B T + Bdwdw T B T . 

We now write A = [ A\ A\ ... A„ ] T and B = [ Bf B% ... B% ] T , where the vectors A k and B k denote the 
fc-th row of matrices A and B, respectively. Then we have 

efd(xx T )ej = ef ' Axx T ejdt + ej B(3 w x T ejdt + e[ Bdwx T ej + ej xx T A T ' tjdt 
+e l x(3j v B 7 'ejdt + e l xdw T B T e j + ej Bdw(dw) T B T e-j 
= AiXXjdt + Bij3 w Xjdt + Bidwxj + XiAjxdt + XiBj(3 w dt + XiBjdw + (Bidw)(Bjdw). (52) 

Also we have 

eJd(xx T )ei = AjXXidt + Bj(3 w Xidt + Bjdwxi + XjAixdt + XjBi(3 w dt + XjBidw + (Bjdw)(Bidw). 

(53) 

Subtracting (IB3T l from (l52l gives us 

efd(xx T )ej — eJd(xx T )ei = {{Aix)xj — Xj(Aix))dt + {{Bi(3 w )xj — Xj{Bi(3 w ))dt 

+ (Bidw)xj — Xj(Bidw) + (xi(Ajx) — (Ajx)xi)dt 
+{xi(Bjf} w ) - {Bjl3 w )xi)dt + (xi(Bjdw) - {Bjdw)xi) 
+((B i dw)(B j dw) - {Bjdw)(Bidw)) 
= {(A i x)x :j - Xj(Aix))dt + {{Bip w )xj - x J {B i f3 w ))dt 
+(xi(Ajx) - (Ajx)xi)dt + (xi(BjP w ) - (Bj(3 w )xi)dt 
+ ((B l dw){B 1 dw) - (Bjdw)(Bidw)). (54) 

Here we are using the fact that elements of dw commute with those of x and j3 w due to the adaptedness of x and j3 w . Hence, 

ef d(xx T )ej — eJd(xx T )ei = [AiX, Xjjdt — [xj, Bi(3 w ]dt + [xi, Ajx]dt + [xt, Bj/3 w ]dt + [Bidw, Bjdw] 

n n n 

= 2J Aik i x k,Xj]dt - 2J B ik [xj,j3 wk ]dt + 2J Aj k [x^ x k ]dt 
fe=l fe=i fc=i 

n n n 

+ ^2 B 3 k[xi, Pwkjdt + ^2 2J B ik Bji[dwk,dwi] 

fc=l k=l 1=1 

(n n n n 

^ J2 A *®ki + 2i E Ajk&ik - E B * c t w + E B * c t w 
k=l k=l k=l k=l 

n n \ 

+ E E BikBji(Fw,ki — Fwjk) ) dt, (55) 
fe=i i=i ) 

where = [xi,(3 W j]. Since C xfiw = \p x i ^\i = \^..^ n ,j=i...,n liw — (by assumption) and — = 2T^, equation (IB3] l 

takes the form 

d(xx T - (xx T ) T ) = 2(iAQ + iOA T + BT i ,B T )dt (56) 

from which the result follows. □ 
Proof of Theorem \ 
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Let us first consider the case where 9 is canonical. If the system is realizable then (TTb-(fT0b holds. Since U (t) is unitary for each 
t > 0, we have that d (x(t)x(t) T — (x(t)x(t) T ) T ) = 0; i.e., the canonical commutation relations are preserved. By Theorem 



2. 11 this is equivalent to ( fT2l . Let Mi, M2, . . . , Mm be column vectors such that [Mi M2 
Then using (O and (O we obtain the following after some algebraic manipulations: 



Ms. J = A r [ / 











2i9[-A+ A T ]T[ 7 nsXjV!/ 
20[-9f(Mi) 3?(Mi) ... - 







= op 



BO 1 P; 



T D T 



iNyXUy 





-iNyXNy 

In v xn. 




n y x(riy.-Ny) \ 

(M Nv ) 5R(MvJ] 
T 



= 6C T dia gAr (J). 



Therefore, we conclude that ( TPl ), ( fT2b and ( fTOb are necessary for realizability. 

Conversely, now suppose that (1131 1. (fT~2b and ( fTOb hold. We will argue that these conditions are sufficient for realizability by 
showing that they imply the existence a symmetric matrix R and a coupling matrix A such that (IT}-© are satisfied. First we 
note that after some simple algebraic manipulation — iQ~ 1 BT~ 1 = iOBT^ 1 = \—Z# Z], for some complex matrix Z. Hence 
B = iO[—Z# Z]T. Substituting the last expression into (TTZt and after further manipulations we get: 



1 



Writing Z#Z 7 



- ZZ^ 

iAQ ^ 



iAe + iOA 1 - -o{z*z T - zz^o = o. 

2i ( 3(Z# Z T ), we may rewrite the last expression as follows: 



l OA T - X -0{Z*Z T 



ZZ r )0 = iAO + iOA T ~im{Z*Z T )Q 

= iQ(Q- 1 A + A T Q- 1 -$(z*z T ))Q 



-OA = V- 
■$(Z*Z T ) 



w 

= 0. 



= iOiO^A- {Q- 1 A) T - %{Z* Z T ))Q = 

implying that 0~ 1 A — (9 _1 A) T — ( i(Z^Z T ) = 0. Since 0~ 1 A is real, we have the decomposition Q~ 1 A = 
for a unique pair of real symmetric matrix V and real skew symmetric matrix W and obtain the condition 2W- 
Hence, W = \^{Z*Z T ). Setting R = \V and A = 2Z T , we get A = 20 (R + 3 (A* A)) and B = 2i9[-A+ A T ] as desired, 
and also prove the second statement of the theorem. After substituting the expression, just obtained for B (in terms of A, 9, 
and T) into ( fl~3l and more algebraic manipulations we then get (O. Since the expression for D has been hypothesized as ( fTOb . 
we conclude that (fT3l l, (TTZt along with (fTOb gives matrices A, B, C, D which are the coefficients of a realizable system. 
Now, we consider the case where 9 is degenerate canonical, i.e., 9 = diag(0„/ xn /, diag „_„' (J))- Let us write 



with An G 

Ci G R"» x ™' 



A = 



An 
A21 



A12 
A22 



B=[Bi B 2 ) C=[C X C 2 ] 



R"' X "', A u G M"'x(»-«') ? A 2 i G »("-«')><"', A 22 G RCn-n'M"-"'), Bl g R™ x ™v, ^ 

and C2 G R"a x ( ,l_Tl ). Consider the following augmentation: 



pnx(n ra -n„) 



dx(t) = 
dy(t) = 



An 
A21 



A12 
A22 
A' 



0, 



0(n-n'-)xr,' x(t)dt 

x{t)dt + Ddw{t) 



Bi 
B'i 



B, 




dw(t) 



where B[ = -Cj_P\ 







P 



and Aj, A 2 and A" satisfy the following: 



.4" 



A'i-(A[f 
-A 2 diag„-„' (J) 



[Si ] T u 



^1 



4 T 
^21 



(sir 


- i [ B{ ] T„B 5 



It follows by inspection that such matrices A[, A' 2 and A" exist. Let A' = [A[ A' 2 ] and define 



.4 
.4' 



Onxn' 
A" 



B 



Bi 
Bi 



B, 




c o„> 



If (fT2l holds then it can be verified, by direct substitution, that the matrices A and B satisfy: 

iAQ + iOA T + BT W B T = 0. 



(57) 
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Recalling that is only canonical up to permutation, we now need to transform it into canonical form. To do this, introduce the 
variable z = Px where P is a permutation matrix such that PQP T = diags(J). Then the components of z are a relabelling 
of the components of x. This gives us the following dynamics for z: 

dz(t) = PAP T z(t) + PBdw(t) 
dy(t) = CP T z(t)dt + Ddw(t). 

Denoting A = pAp t , B = PB, C = CP T , and = diags (J) we see that (|57]i implies that: 

tie + i<dA T + BT W B T = 0. (58) 

Continuing further using < fT~3T >, we have the following: 



B 







.j)X1 



P 



P 



PO 



B 
B[ 

ec T 
-c? 

C T 








(n w —n y ) X 7ly 



(PGP T )P 



© c T Pl 



p T 



P T 

C T 




-I 





-/ 





Pi 



P: 



n„ 



Pn v 

/ 

-/ 



p 



p Ny = ec T di agN (j). 



(59) 



If D is given by dTOb then ( 1581 and ( f59b implies, as we have already shown for the case of canonical 0, the system defined 
by the matrices (A, B, C, D) is realizable in the sense of Point l of the theorem. Hence, the original system defined by the 
matrices (^4, B, C, D) is then realizable in the sense of Point 2 of the theorem. 

Finally, suppose conversely that (Q~|) is realizable and let (A, B, C, D) be a suitable augmentation. Then 
(PAP T , PB,CP T , D) is a quantum harmonic oscillator, with P as defined before. Hence, PAP T , PB, CP T , and D are 
given by the right hand sides of (l7]i-(fT0li for a canonical 9 and some R and A. It follows that A, B, C and D are given by 
the same set of equations by replacing O, R and A by = P T QP, R = P T RP and A = AP, respectively. We then have, 
from the same line of arguments given for the case of canonical 0, that: 



B 



= ®C T Pn v 





-In v xn v 



iNyXNy 





P Ny =0C T diag Wy (J), 



(60) 



lily X TLy 

^{nyj —ny ) xn y 

d57i i holds, and D satisfies ( fTOb . Reading off the first n rows of both sides of ( f60b then gives us ( fT3l ), while reading of the 
first n rows and columns of both sides of dBTb gives us ( 112) . as required. This completes the proof. □ 
The proof of Theorem 14.21 will use the following lemma. 

Lemma A.l: Consider a real symmetric matrix X and corresponding operator valued quadratic form x T Xx for the system 
(1151 . Then the following statements are equivalent: 

(i) There exists a constant A > such that (p, x T Xx) < A for all Gaussian states p0 

(ii) The matrix X is negative semidefinite. 

Proof (i) (ii). To establish this part of the lemma, consider a Gaussian state p which has mean x and covariance matrix 
Y > 0. Then, we can write 



(p,x T Xx) 



i=l j=l 



EE 

i=l j=l 



XiXj 



Xx + tr[XY] 



(61) 



(62) 



Now for any constant a > 0, consider the inequality of part (i) where p is a Gaussian state with mean ax and covariance 
matrix Y. Then it follows from this bound and ( fSTb that a 2 x T Xx + tr[XY] < A for all a > 0. From this it immediately 
follows that x T Xx < 0. However 5, the mean of the Gaussian state p was arbitrary. Hence, we can conclude that condition 
(ii) of the lemma is satisfied. 

(ii) (i). Suppose that the matrix X is negative semidefinite and let p be any Gaussian state and suppose that p has mean 
x and covariance matrix Y > 0. Then, it follows from doTT ) that (p,x T Xx) = x T Xx + tr[XY] .However, X < and Y > 
implies x T Xx < and tr[XY] < 0. Hence, (p, x T Xx) < and condition (ii) is satisfied with A = 0. □ 



3 Here (p, ■) denotes the expectation with respect to the Gaussian state p. 
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Proof of Theorem \4.2\ Let the system be dissipative with V(x) - 
stochastic differential equation ( fl~5T > we have 

d(V(x(t))) = (dx T (t)Xx(t) + x T {t)Xdx{t) + dx T (t)Xdx(t)) 

= (x T (t)(A T X + XA)x(t) + Pl(t)B T Xx(t) + x T (t)XB/3 w (t) + A ) dt, 

where Ao is given by ( fT9b . We now note that (e.g, see [19, page 215]) (V(x(t)) = (p, Eo[V(x(t))]), where Eq denotes 
expectation with respect to <f>, and p is an initial Gaussian state. Combining this with the integral of d63l and ( fToT l we find that 

r E [x T {s)(A T X + XA)x{s) + l3l(s)B T Xx{s) + x T {s)X B/3 w {s) + A + r(x{s), w (s)]ds\ < Xt. 



Xx. By Ito's rule, the table <[2Qb and the quantum 



(63) 



Let t — > to obtain 



p, x 1 {A 1 X + XA)x + fii^B' X + x r XB/3 w + A + [x 1 ' p%]R 



< A. 



Here, x and f3 w denote the initial conditions. An application of Lemma I A. 1 1 implies (fTTT i. Also, (fT8T i is a straightforward 
consequence of this inequality when R is replaced by R + el where e > 0. 

To establish the converse part of the theorem, we first assume that (T7\ is satisfied. Then with V(x) = x T Xx, it follows 
from d63l that 



(V(x(t))) - (V(x(0))) 



(r(x(s),p w (s)))ds < X t 



for all t > and all (3 w (t). Hence, inequality (fTol l is satisfied with A given by dT9b . 

If matrix inequality <TT~8T > is satisfied, then it follows by similar reasoning that there exists an e > such that 



(V(x(t))) - (V(x(0))} 



(r{x(s),f3 u ,{s)) + e(x{s) T x(s) + p w {s) T p w {s)))ds < X t. 



Hence, inequality ( fT6l ) is satisfied with A = Ao given by $19[ and with R replaced by by R + el. □ 
Proof of Theorem 15.31 Using the Strict Bounded Real Lemma Corollary 14.51 the theorem follows directly from the corre- 
sponding classical H°° result; e.g., see [15], [20], [32]. □ 
The proof of Theorem 15.41 will use the following lemma. 

Lemma A.2: If S is a Hermitian matrix then there is a real constant ao such that al + S > for all a> a$. 

Proof. Since S is Hermitian it has real eigenvalues and is diagonalizable. Hence S = V'EV for some real diagonal 
matrix E and orthogonal matrix V. Now let ao = —A, where A is the smallest eigenvalue of S. The result follows since 
al + S = V^(al + E)V while al + E > for all a > a . □ 

Proof of Lemma\5J\ The main idea is to explicitly construct matrices R € R" KXnK ,AG £N V[c xn K ^ Bri g W i k x2(n vk +n v ) 
and B K0 e R 1i<x2Nv k, with N VK > N u , such that d7]»-([T0j are satisfied by identifying A K , B K , C K , [ B K0 0i KX m K ], ^, 
wk and u with A, B, C, D, x, w and y, respectively. To this end, let Z = jQ^ A = —^QkA, with 6^ = diagjy (J). We 
first construct matrices A&2, Afti, Bk\,\ and Bk\,i according to the following procedure: 

1) Construct the matrix Am according to (l34l . 

2) Construct a real symmetric % x ri K matrix Hj such that the matrix 

'Z-Z T 



■—2 



"1 



1 



r 1 p 1 





-I 



P Nv C K - 9f(AT A 62 ) 



is non-negative definite. It follows from Lemma IA.2I that such a matrix Si always exists. 

3) Construct a matrix Am such that A^A^i = S2, where Ahi has at least 1 row. This can be done, for example, using the 
singular value decomposition of S2 (in this case Af,i will have uk rows). 

4) Construct the matrices Bk\.\ and Bki,2 according to equations ( 1331 and (f35j), respectively. 

Let R = \{Z + Z T ). We now show that there exists an integer N^ K > such conditions (ITTi-(fT0]i are satisfied with the 
matrix R as defined and with Bki = [ Bki,i Bk 1,2 } and 



A = 



A 6 i 
A b2 



(64) 



First note that necessarily N VK > N u 
Afci we have 



1 > N u since Bki has at least 2N U + 2 columns. Also, by virtue of our choice of 



^(A^Am) = 9f(S a ) = \{Z Z T ) - \c T K P T Nu 





-I 



Pn u C k -3(A^ 2 A b2 ), 



20 



and hence 



3(AtA) = %(AlA bl ) + 3(At 2 A b2 ) + \c T K P^ 



I 

-I 



Pn u C k 



Since R = we have R + Sj(A t A) = Z. Therefore, © is satisfied. 

Now, as in the proof of Theorem |3~4l observe that i@ K B K dia,g N (M^)P^ = [ T -T* } for some riK x N y complex 

y y i 

matrix T. But by taking the conjugate transpose of both sides of ( [34-b which defined A(,2, we conclude that T = — Aj 2 . Hence, 

Bk = 2i9x[ — A^ 2 Aj 2 ]PN y di&g Ny (M). From < f33T > which defined A&i, we obtain 



5 K 



l.i 



-iGjcC^diagj^ (iJ) 

-iO^Cjdiag^ (i J)(2dia giVti (M^))dmg Nu (M) 

-1 1 

i i 

-I I 



i<d K C K diag N ( 



iQ K C K Pl 



il il 



)dia gjVtt (M) 
PAr u diag JVu (M). 



(65) 



Combining (l35l l, ([Al l and (f65t gives us 



-E>ai 



1 Bki,2 
2iQ K 



B K 



2 K N-u 



-I 
il 



I 

il 



R 



P T 



. Pn w diag„ (M) 



2i6 



A' 



2i9A- 



ir7 T p t 



2°A- r Af„ 



-At a t ] r. 



7 

-il 
I 

-il 



N u 



A T 



(AT -JV„) 



[-4 



b2 



A T 

IV b2 



-A 



1/2 



-A 



1/2 



krfr pT 

2°A- r A r „ 



2 Ly A- r A r „ 



il 


A T 


A T 




I 

il 


A T 


A T 

lv b2 


r 



Therefore, ((HJ is also satisfied. Moreover, it is straightforward to verify (0 by substituting A as defined by ( RPfl i into the right 
hand side of (|9). Finally, since N VK > N u , it follows that [ Bkq Oi K xm k ] is precisely the right hand side of (ITOb . This 
completes the proof of Theorem 15.41 □ 
Proof of Lemma EOl We first observe that the system d38l l is mean square stable if and only if it is dissipative with a supply rate 
defined by the matrix R = diag(I, 0). Hence, it follows from Theorem |4.2| that the system d38l l is mean square stable if and only 
if there exists a real positive definite symmetric matrix X such that A T X + XA + I < 0. Hence, using a standard Lyapunov 
result (e.g., see [32]), it follows that the system ((38) is mean square stable if and only if the matrix A is asymptotically stable. 
□ 

Proof of Theorem 16.31 It follows from Corollary 14.51 that the closed loop quantum system ( f25l ) is strictly bounded real with 
disturbance attenuation g, then A is a stable matrix and \\C(sI — A)^ 1 B + D\\ x < g. From this, it follows using the standard 
small gain theorem (e.g., see Theorem 9.1 on page 218 of [32]) that the matrix A = A + BAC is stable for all A satisfying 
d39i >. Hence using Lemma [6721 it follows that the true closed loop system ( f38l > is mean square stable for all A satisfying d39l ). 

□ 
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